A new algorithm for particle weighted subtraction to decrease signals from unwanted components in single particle analysis.

Single particle analysis (SPA) in cryo-electron microscopy (cryo-EM) is highly used to obtain the near-atomic structure of biological macromolecules. The current methods allow users to produce high-resolution maps from many samples. However, there are still challenging cases that require extra processing to obtain high resolution. This is the case when the macromolecule of the sample is composed of different components and we want to focus just on one of them. For example, if the macromolecule is composed of several flexible subunits and we are interested in a specific one, if it is embedded in a viral capsid environment, or if it has additional components to stabilize it, such as nanodiscs. The signal from these components, which in principle we are not interested in, can be removed from the particles using a projection subtraction method. Currently, there are two projection subtraction methods used in practice and both have some limitations. In fact, after evaluating their results, we consider that the problem is still open to new solutions, as they do not fully remove the signal of the components that are not of interest. Our aim is to develop a new and more precise projection subtraction method, improving the performance of state-of-the-art methods. We tested our algorithm with data from public databases and an in-house data set. In this work, we show that the performance of our algorithm improves the results obtained by others, including the localization of small ligands, such as drugs, whose binding location is unknown a priori.

Image processing tools for the validation of CryoEM maps.

The number of maps deposited in public databases (Electron Microscopy Data Bank, EMDB) determined by cryo-electron microscopy has quickly grown in recent years. With this rapid growth, it is critical to guarantee their quality. So far, map validation has primarily focused on the agreement between maps and models. From the image processing perspective, the validation has been mostly restricted to using two half-maps and the measurement of their internal consistency. In this article, we suggest that map validation can be taken much further from the point of view of image processing if 2D classes, particles, angles, coordinates, defoci, and micrographs are also provided. We present a progressive validation scheme that qualifies a result validation status from 0 to 5 and offers three optional qualifiers (A, W, and O) that can be added. The simplest validation state is 0, while the most complete would be 5AWO. This scheme has been implemented in a website https://biocomp.cnb.csic.es/EMValidationService/ to which reconstructed maps and their ESI can be uploaded.

ScipionTomo: Towards cryo-electron tomography software integration, reproducibility, and validation.

Image processing in cryogenic electron tomography (cryoET) is currently at a similar state as Single Particle Analysis (SPA) in cryogenic electron microscopy (cryoEM) was a few years ago. Its data processing workflows are far from being well defined and the user experience is still not smooth. Moreover, file formats of different software packages and their associated metadata are not standardized, mainly since different packages are developed by different groups, focusing on different steps of the data processing pipeline. The Scipion framework, originally developed for SPA (de la Rosa-Trevín et al., 2016), has a generic python workflow engine that gives it the versatility to be extended to other fields, as demonstrated for model building (Martínez et al., 2020). In this article, we provide an extension of Scipion based on a set of tomography plugins (referred to as ScipionTomo hereafter), with a similar purpose: to allow users to be focused on the data processing and analysis instead of having to deal with multiple software installation issues and the inconvenience of switching from one to another, converting metadata files, managing possible incompatibilities, scripting (writing a simple program in a language that the computer must convert to machine language each time the program is run), etcetera. Additionally, having all the software available in an integrated platform allows comparing the results of different algorithms trying to solve the same problem. In this way, the commonalities and differences between estimated parameters shed light on which results can be more trusted than others. ScipionTomo is developed by a collaborative multidisciplinary team composed of Scipion team engineers, structural biologists, and in some cases, the developers whose software packages have been integrated. It is open to anyone in the field willing to contribute to this project. The result is a framework extension that combines the acquired knowledge of Scipion developers in close collaboration with third-party developers, and the on-demand design of functionalities requested by beta testers applying this solution to actual biological problems.

On bias, variance, overfitting, gold standard and consensus in single-particle analysis by cryo-electron microscopy.

Cryo-electron microscopy (cryoEM) has become a well established technique to elucidate the 3D structures of biological macromolecules. Projection images from thousands of macromolecules that are assumed to be structurally identical are combined into a single 3D map representing the Coulomb potential of the macromolecule under study. This article discusses possible caveats along the image-processing path and how to avoid them to obtain a reliable 3D structure. Some of these problems are very well known in the community. These may be referred to as sample-related (such as specimen denaturation at interfaces or non-uniform projection geometry leading to underrepresented projection directions). The rest are related to the algorithms used. While some have been discussed in depth in the literature, such as the use of an incorrect initial volume, others have received much less attention. However, they are fundamental in any data-analysis approach. Chiefly among them, instabilities in estimating many of the key parameters that are required for a correct 3D reconstruction that occur all along the processing workflow are referred to, which may significantly affect the reliability of the whole process. In the field, the term overfitting has been coined to refer to some particular kinds of artifacts. It is argued that overfitting is a statistical bias in key parameter-estimation steps in the 3D reconstruction process, including intrinsic algorithmic bias. It is also shown that common tools (Fourier shell correlation) and strategies (gold standard) that are normally used to detect or prevent overfitting do not fully protect against it. Alternatively, it is proposed that detecting the bias that leads to overfitting is much easier when addressed at the level of parameter estimation, rather than detecting it once the particle images have been combined into a 3D map. Comparing the results from multiple algorithms (or at least, independent executions of the same algorithm) can detect parameter bias. These multiple executions could then be averaged to give a lower variance estimate of the underlying parameters.

Cryo-EM density maps adjustment for subtraction, consensus and sharpening.

Electron cryomicroscopy (cryo-EM) has emerged as a powerful structural biology instrument to solve near-atomic three-dimensional structures. Despite the fast growth in the number of density maps generated from cryo-EM data, comparison tools among these reconstructions are still lacking. Current proposals to compare cryo-EM data derived volumes perform map subtraction based on adjustment of each volume grey level to the same scale. We present here a more sophisticated way of adjusting the volumes before comparing, which implies adjustment of grey level scale and spectrum energy, but keeping phases intact inside a mask and imposing the results to be strictly positive. The adjustment that we propose leaves the volumes in the same numeric frame, allowing to perform operations among the adjusted volumes in a more reliable way. This adjustment can be a preliminary step for several applications such as comparison through subtraction, map sharpening, or combination of volumes through a consensus that selects the best resolved parts of each input map. Our development might also be used as a sharpening method using an atomic model as a reference. We illustrate the applicability of this algorithm with the reconstructions derived of several experimental examples. This algorithm is implemented in Xmipp software package and its applications are user-friendly accessible through the cryo-EM image processing framework Scipion.

Cryo-EM and Single-Particle Analysis with Scipion.

Cryo-electron microscopy has become one of the most important tools in biological research to reveal the structural information of macromolecules at near-atomic resolution. In single-particle analysis, the vitrified sample is imaged by an electron beam and the detectors at the end of the microscope column produce movies of that sample. These movies contain thousands of images of identical particles in random orientations. The data need to go through an image processing workflow with multiple steps to obtain the final 3D reconstructed volume. The goal of the image processing workflow is to identify the acquisition parameters to be able to reconstruct the specimen under study. Scipion provides all the tools to create this workflow using several image processing packages in an integrative framework, also allowing the traceability of the results. In this article the whole image processing workflow in Scipion is presented and discussed with data coming from a real test case, giving all the details necessary to go from the movies obtained by the microscope to a high resolution final 3D reconstruction. Also, the power of using consensus tools that allow combining methods, and confirming results along every step of the workflow, improving the accuracy of the obtained results, is discussed.

Algorithmic robustness to preferred orientations in single particle analysis by CryoEM.

The presence of preferred orientations in single particle analysis (SPA) by cryo-Electron Microscopy (cryoEM) is currently one of the hurdles preventing many structural analyses from yielding high-resolution structures. Although the existence of preferred orientations is mostly related to the grid preparation, in this technical note, we show that some image processing algorithms used for angular assignment and three-dimensional (3D) reconstruction are more robust than others to these detrimental conditions. We exemplify this argument with three different data sets in which the presence of preferred orientations hindered achieving a 3D reconstruction without artifacts or, even worse, a 3D reconstruction could never be achieved.

Measurement of local resolution in electron tomography.

Resolution (global and local) is one of the most reported metrics of quality measurement in Single Particle Analysis (SPA). However, in electron tomography, the situation is different and its computation is not straightforward. Typically, resolution estimation is global and, therefore, reduces the assessment of a whole tomogram to a single number. However, it is known that tomogram quality is spatially variant. Still, up to our knowledge, a method to estimate local quality metrics in tomography is lacking. This work introduces MonoTomo, a method developed to estimate locally in a tomogram the highest reliable frequency component, expressed as a form of local resolution. The fundamentals lie in a local analysis of the density map via monogenic signals, which, in analogy to MonoRes, allows for local estimations. Results with experimental data show that the local resolution range that MonoTomo casts agrees with reported resolution values for experimental data sets, with the advantage of providing a local estimation. A range of applications of MonoTomo are suggested for further exploration.

Integration of Cryo-EM Model Building Software in Scipion.

Advances in cryo-electron microscopy (cryo-EM) have made it possible to obtain structures of large biological macromolecules at near-atomic resolution. This "resolution revolution" has encouraged the use and development of modeling tools able to produce high-quality atomic models from cryo-EM density maps. Unfortunately, many practical problems appear when combining different packages in the same processing workflow, which make difficult the use of these tools by non-experts and, therefore, reduce their utility. We present here a major extension of the image processing framework Scipion that provides inter-package integration in the model building area and full tracking of the complete workflow, from image processing to structure validation.

Re-examining the spectra of macromolecules. Current practice of spectral quasi B-factor flattening.

The analysis of structure factors in 3D cryo-EM Coulomb potential maps and their "enhancement" at the end of the reconstruction process is a well-established practice, normally referred to as sharpening. The aim is to increase contrast and, in this way, to help tracing the atomic model. The most common way to accomplish this enhancement is by means of the so-called B-factor correction, which applies a global filter to boost high frequencies with some dampening considerations related to noise amplification. The results are maps with a better visual aspect and a quasiflat spectrum at medium and high frequencies. This practice is so widespread that most map depositions in the Electron Microscopy Data Base (EMDB) only contain sharpened maps. Here, the use in cryoEM of global B-factor corrections is theoretically and experimentally analyzed. Results clearly illustrate that protein spectra present a falloff. Thus, spectral quasi-flattening may produce protein spectra with distortions when compared with experimental ones, this fact, combined with the practice of reporting only sharpened maps, generates a sub-optimal situation in terms of data preservation, reuse and reproducibility. Now that the field is more advanced, we put forward two suggestions: (1) to use methods which keep more faithfully the original experimental signal properties of macromolecules when "enhancing" the map, and (2) to further stress the need to deposit the original experimental maps without any postprocessing or sharpening, not only the enhanced maps. In the absence of access to these original maps data is lost, preventing their future analysis with new methods.

Flexible workflows for on-the-fly electron-microscopy single-particle image processing using Scipion.

Electron microscopy of macromolecular structures is an approach that is in increasing demand in the field of structural biology. The automation of image acquisition has greatly increased the potential throughput of electron microscopy. Here, the focus is on the possibilities in Scipion to implement flexible and robust image-processing workflows that allow the electron-microscope operator and the user to monitor the quality of image acquisition, assessing very simple acquisition measures or obtaining a first estimate of the initial volume, or the data resolution and heterogeneity, without any need for programming skills. These workflows can implement intelligent automatic decisions and they can warn the user of possible acquisition failures. These concepts are illustrated by analysis of the well known 2.2 Šresolution ß-galactosidase data set.

Survey of the analysis of continuous conformational variability of biological macromolecules by electron microscopy.

Single-particle analysis by electron microscopy is a well established technique for analyzing the three-dimensional structures of biological macromolecules. Besides its ability to produce high-resolution structures, it also provides insights into the dynamic behavior of the structures by elucidating their conformational variability. Here, the different image-processing methods currently available to study continuous conformational changes are reviewed.

Using Scipion for stream image processing at Cryo-EM facilities.

Three dimensional electron microscopy is becoming a very data-intensive field in which vast amounts of experimental images are acquired at high speed. To manage such large-scale projects, we had previously developed a modular workflow system called Scipion (de la Rosa-Trevín et al., 2016). We present here a major extension of Scipion that allows processing of EM images while the data is being acquired. This approach helps to detect problems at early stages, saves computing time and provides users with a detailed evaluation of the data quality before the acquisition is finished. At present, Scipion has been deployed and is in production mode in seven Cryo-EM facilities throughout the world.

Map challenge: Analysis using a pair comparison method based on Fourier shell correlation.

This document presents the analysis performed over the Map Challenge dataset using a new algorithm which we refer to as Pair Comparison Method. The new algorithm, which is described in detail in the text, is able to sort reconstructions based on a figure of merit and assigns a level of significance to the sorting. That is, it shows how likely the sorting is due to chance or if it reflects real differences.

A new algorithm for high-resolution reconstruction of single particles by electron microscopy.

The Map Challenge organized by the Electron Microscopy Data Bank has prompted the development of an Xmipp high resolution reconstruction protocol (which we will refer to as highres) that is integrated in the software platform Scipion. In this work we describe the details of the image angular alignment and map reconstruction steps in our new method. This algorithm is similar to the standard projection matching approach with some important modifications, especially in the area of detecting significant features in the reconstructed volume. We show that the new method is able to produce higher resolution maps than the current de facto standard as measured by the Fourier Shell Correlation, the Monogenic Local Resolution and EMRinger.

Blind estimation of DED camera gain in Electron Microscopy.

The introduction of Direct Electron Detector (DED) videos in the Electron Microscope field has boosted Single Particle Analysis to a point in which it is currently considered to be a key technique in Structural Biology. In this article we introduce an approach to estimate the DED camera gain at each pixel from the movies themselves. This gain is needed to have the set of recorded frames into a coherent gray level range, homogeneous over the whole image. The algorithm does not need any other input than the DED movie itself, being capable of providing an estimate of the camera gain image, helping to identify dead pixels and cases of incorrectly calibrated cameras. We propose the algorithm to be used either to validate the experimentally acquired gain image (for instance, to follow its possible change over time) or to verify that there is no residual gain image after experimentally correcting for the camera gain. We show results for a number of DED camera models currently in use (DE, Falcon II, Falcon 3, and K2).

A review of resolution measures and related aspects in 3D Electron Microscopy.

Fourier Shell Correlation, Spectral Signal-to-Noise Ratio, Fourier Neighbour Correlation, and Differential Phase Residual are different measures that have been proposed over time to determine the spatial resolution achieved by a certain 3D reconstruction. Estimates of B-factors to describe the reduction in signal-to-noise ratio with increasing resolution is also a useful parameter. All these concepts are interrelated and different thresholds have been given for each one of them. However, the problem of resolution assessment in 3DEM is still far from settled and preferences are normally adopted in order to choose the "correct" threshold. In this paper we review the different concepts, their theoretical foundations and the derivation of their statistical distributions (the basis for establishing sensible thresholds). We provide theoretical justifications for some common practices in the field for which a formal justification was missing. We also analyze the relationship between SSNR and B-factors, the electron dose needed for achieving a given contrast and resolution, the number of images required, etc. Finally, we review the consequences for the number of particles needed to achieve a certain resolution and how to analyze the Signal-to-Noise Ratio for a sequence of imaging operations.

A Survey of the Use of Iterative Reconstruction Algorithms in Electron Microscopy.

One of the key steps in Electron Microscopy is the tomographic reconstruction of a three-dimensional (3D) map of the specimen being studied from a set of two-dimensional (2D) projections acquired at the microscope. This tomographic reconstruction may be performed with different reconstruction algorithms that can be grouped into several large families: direct Fourier inversion methods, back-projection methods, Radon methods, or iterative algorithms. In this review, we focus on the latter family of algorithms, explaining the mathematical rationale behind the different algorithms in this family as they have been introduced in the field of Electron Microscopy. We cover their use in Single Particle Analysis (SPA) as well as in Electron Tomography (ET).

Fast and automatic identification of particle tilt pairs based on Delaunay triangulation.

Random conical tilt (RCT) and orthogonal tilt reconstruction (OTR) are two remarkable methods for reconstructing the three-dimensional structure of macromolecules at low resolution. These techniques use two images at two different sample tilts. One of the most demanding steps in these methods at the image processing level is to identify corresponding particles on both micrographs, and manual or semiautomatic matching methods are usually used. Here we present an approach to solve this bottleneck with a fully automatic method for assigning particle tilt pairs. This new algorithm behaves correctly with a variety of samples, covering the range from small to large macromolecules and from sparse to densely populated fields of view. It is also more rapid than previous approaches. The roots of the method lie in a Delaunay triangulation of the set of independently picked coordinates on both the untilted and tilted micrographs. These triangulations are then used to search an affine transformation between the untilted and tilted triangles. The affine transformation that maximizes the number of correspondences between the two micrographs defines the coordinate matching.

Local analysis of strains and rotations for macromolecular electron microscopy maps.

Macromolecular complexes perform their physiological functions by local rearrangements of their constituents and biochemically interacting with their reaction partners. These rearrangements may involve local rotations and the induction of local strains causing different mechanical efforts and stretches at the different areas of the protein. The analysis of these local deformations may reveal important insight into the way proteins perform their tasks. In this paper we introduce a method to perform this kind of local analysis using Electron Microscopy volumes in a fully objective and automatic manner. For doing so, we exploit the continuous nature of the result of an elastic image registration using B-splines as its basis functions. We show that the results obtained by the new automatic method are consistent with previous observations on these macromolecules.